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Abstract — Image denoising is a serious problem in image 
processing.Before processing image for further analysis it is 
important to remove noise from that image.Many denoising 
algorithms are available but they have their own 
assumptions, advantages and limitations. 

Noise in synthetic images is easily recognised by human 
eye rather than natural images.Recently, different state of the 
art methods are proposed for denoising synthetic images.In this 
paper, comparative analysis of different image denoising 
methods is done.This paper presents results for natural and 
synthetic images contaminated with different type of noise. 

Index Terms — AWGN, bilateral filtering deterministic 
annealing, , image denoising, robust noise estimation. 

I. INTRODUCTION 

In image processing, the classic image denoising problem 
is the reconstruction of the original image from a noisy 
image. Noise may get added to the image during acquisition 
of image or during transport over analog media. Image has 
been contaminated with additive white Guassian 
noise( AWGN) is the most common simplifying assumption. 
It is also assumed that noise is stationary and uncorrelated 
among pixels and its variance is known. 

Recently Knaus and Zwicker demonstrated with dual 
domain image denoising (DDID) that simple algorithms can 
achieve high-quality results [1]. DDID combines two methods 
operating in two different domains i.e spatial domain and 
frequency domain.This formulation gives better results than 
used seperately . 

They extended their work and propose progressive image 
denoising a method based on robust noise estimation 
deterministic annealing. 

We have approached for quantitative and qualitative 
analysis of this algorithm for different types of noises like 
AWGN, Salt & pepper noise , Poisson noise.In this paper, we 
used two methods i.e Dual domain image denoising (DDID) 
and Progressive image denoising(PID. 

The bilateral filter is known for its edge -preserving 
properties. It retains high-contrast features like edges, but 
cannot preserve low-contrast detail like textures without 
introducing noise. STFT wavelet shrinkage on the other hand 
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results in good detail preservation, but suffers from ringing 
artifacts near steep edges. [1]. These two methods are 
combined to form a new method called DDID.Fig.l shows 
the block diagram for DDID. 



Fig.l Block diagram for Dual Domain Image 
Denoising(DDID) . 

Deterministic annealing is a efficient heuristic method for 
solving complex optimization where many local extrema 
exist[3][4]. As like typical high -quality results, void of 
artifacts are more apparent. The algorithm is usually short 
fitting into a column of this paper .Finally this formulation 
using robust estimators and iterative filtering offers 
oppurtunities to explore alternative implementations of the 
image denoising process. Fig . 1 shows the block diagram for 
Progressive Image Denoising(PID). 



Fig .2 Block diagram for Progressive Image Denoising(PID) 

Later, this paper is organized as follows. The two 
algorithms of DDID and PID are described in section II, 
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followed by implementation details in section III . High 
Quality results and comparative study for different types of 
noise is presented in section IV and section V includes the 
conclusion. 


II. ALGORITHM 

In this section we describe the image denoising algorithm 
based on deterministic annealing & robust noise estimation & 
which is implemented using a simple iterative filtering 
scheme. 

A. Progressive Noise Removal 

A signal O has been contaminated with additive white 
guassian noise n and variance a 2 The task is to decompose 
the noisy signal I into its original signal O and noise n like. 

I = 0 + n . ( 1 ) 

But in practice, we can only estimate a decomposition 

I = O + TI .Many of the estimation problems are often 
formulated as energy minimizing problems. Attempt to 
formulate denoising as a gradient descent with 

= O i - X VE (O i) (2) 

Starting at O 0 =/. The scale factor X controls the step size in 
the direction of the gradient descent. An attempt to define the 
energy term as E (Oi)=( Oi-Of fails , since ‘O’ is unknown. 
However, it is empirically discovered that the gradient of this 
energy , VE((7)can be estimated as a noise estimate n x for 
iteration. Substituting VE (O we get. 

O i+1 = O t - Xrii (3) 

Allowing us to reinterpret the gradient descent as a 
progressive removal of noise differentials AiZi, which 
integrate over time i the estimated total noise instance as 

00 

n=^ n i • 

z=0 


value q ^ from all the neighboring pixels o t q yielding a 
“gradient” d ipq as 

di,p,q— Oi,q~Oi,p. (4) 

With the help of this gradient, two kernels defined to mask 
out large signals, one is range kernel kr and another spatial 
kernel ks, limitng bias from spatially distant pixels.These 
two kernels combine to an unormalized bilateral kernel. 
Finally, to obtain masked signal in frequency domain 7p, 
performing a discrete fourier transform, yielding the fourier 

coefficients D ip j for frequency f as 
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To avoid confusion with the time i, we used here the 
imaginary number j= V— T .The variables 7 and S t are 


scale parameters which we will describe in section II -C. 

Again in frequency domain , another range kernel K is 
used to mask out large Fourier coefficients d 


representing fine structures and details. Finally, estimating 
the noise by taking the center pixel after inverse Fourier 
transforming the signal. To obtain this value, applying the 
Fourier slicing theorem and 
average over all the Fourier coefficients and get 
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where, y is another scale parameter which in this case the 
variance of the Fourier coefficients D p ^ and is given as 

V=a 2 L Kr ( UUp [ q]>2 ) 2 Ks ( ]q ~ p]2 ) 2 

q&Np Ti Si / r~j \ 


B. Robust Noise Estimation 

In order to estimate the noise m for iteration /, it is 
necessary to distinguish signal from noise. Hence, 
conceptually decomposing the noisy signal in three 
categories: large and medium ampitude signals and medium 
amplitude noise. Spatial domain can be selected for 
recognising large amplitude signals. But if the amplitude of 
the signal is smaller ,more similar to the noise, signal and 
noise cannot be realiably distinguished in the spatial domain. 
However, the property that signal is autocorrelated and noise 
is uncorrelated can be utilised. Auto-correlated signals ,i.e 
waves are best detected as large amplitude signals in the 
frequency domain. Therefore, by using robust estimators to 
reject large amplitude gradients in spatial domain and 
medium amplitude gradients in frequency domain ,the small 
amplitude noise is estimated. 

Consider pixel p using pixels q in a neighborhood window 
y with window radius r. We first subtract the center pixel 


C. Shape shifting Estimator 

For the dynamic parameterization of the robust noise 
estimator we define the scale parameters T- and S i as 
functions of time i: 

T ,=° 2 Y r a' (g) 

S, = cr s V/A (9) 

The first scale parameter 7 of the range kernel kr is our 

temperature which is reduced over time. We found that an 
exponential decay of the temperature works best, where a~ 1 
is the rate of this decay, yr is a large initial scale factor. The 
second scale parameter s. , however, we let grow. When the 

temperature 7 is high, the range kernel kr covers the entire 

dynamic range and the spatial kernel ks should be small to 
reduce bias from neighbouring pixels in the noise estimation. 
On the other hand, when the temperature is low, the range 
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kernel becomes narrow and we require larger spatial support 
to discern autocorrelated signal with small amplitudes from 
noise. When the temperature has totally cooled down, the 
range kernel is a Dirac delta, and the spatial kernel is the 
constant 1 , covering the entire spatial domain. The parameter 
g2 is the noise variance of the noisy input y and as defines 
a reference standard deviation for the spatial kernel. Similar 
to the parameter yr of the range kernel, ys is a small initial 
scale factor for the scale as of the spatial kernel. 

For completeness, we add the algorithm of DDID in this 
paper. Fig. 3 shows flowchart for DDID. 

A. Spatial domain : Bilateral filter 

In the first step, calculate the denoised high-contrast value 
for a pixel p using a joint bilateral filter .The joint bilateral 
filter uses the guide image to filter the noisy image .The 
bilateral kernel over a square neighborhood window 
centered around every pixel p with window radius r is 
defined. Since it is needed to guide not only the bilateral filter 
but also the wavelet shrinkage, filtering both guide and 
noisy images in parallel and obtain the two denoised 
high-contrast images. 



Fig. 3. Flowchart for DDID 

B. Frequency Domain: Wavelet Shrinkage 

In the second step, preparing for the wavelet shrinkage in 
the transform domain by extracting the low-contrast signals 
and performing the STFT. The STFT is a discrete Fourier 
transform (DFT) preceded by multiplication of the signal 
with a window function to avoid boundary artifacts. When 
the spatial Gaussian of the bilateral kernel as the window 
function is choosen, and the entire step becomes a Gabor 
transform of the low-contrast signal. To transition to the 
frequency domain, performing a non-unitary DFT. 


Ill . IMPLEMENT ATION 

Unlike most other image denoising methods this 
algorithm is simple enough and a MATLB implementation 
for gray scale images is given in this paper. 

The formulation of the original DDID uses a wavelet 
shrinkage kernel in the frequency domain which is replaced 
by the robust noise estimation in PID. 

We used a single real-time image and a computer generated 
synthetic image. Both the images are degraded by adding 
three types of noise namely, AWGN, Salt & pepper and 
Poisson noise. 

The parameters in the algorithm were empirically found 
and are the same for all noise levels. We use N=30 with a 
temperature delay rate of a" 1 =1.533 _1 & gradient step size 
A,=0.567 log a. These parameters change together. The initial 
scale factor for the range scale is y r =988.5 and for the spatial 
scale y s =2/9. The window radios is = 15, and reference spatial 
sigma of <j s =7 for the final DDID step, we use a larger kernel 

size with window radios r= 31 and spatial sigma <j s =16. The 

range and frequency domain parameters are y r =0.6 & y s 
=2.16. 

The number of iterations N needs to be large enough to get 
good denoising results. The gradient descent step factor X has 
the effective biggest influence on PSNR. Small values means 
that the noise will be underestimated & consequently the 
image will contain residual noise. Conversely, large values 
means that the noise is over estimated & the image will loose 
details. The remaining parameters are robust against change 
& are optimal with tolerance in range of 0.1 dB. 

For color images, a 3- point discrete cosine transform. Can 
be performed on the color channels. The noise variance 
remain constant& uncorrelated, since DCT is a unitary 
transformation. For the range kernel definition, the 
normalized Eucledian distances are averaged independently 
in frequency domain. 

IV.Results 

In this section , we present the results of algorithm for 
grayscale images. We analyze the denoising process for 
natural and synthetic images. 

Table I and Table II compares the peak signal -to-noise 
ratio (PSNR) of DDID and PID for same images. We choose 
g= 25 as the standard deviation of the noise. Numerically, 
DDID and PID show comparable denoising quality. 

We used 30 iterations wherein the PSNR increases fast in 
beginning and slows down as noise becomes smaller.The 
corresponding MSE exhibits a strong linear decrease and 
approach the square bias as the variance . 

Table I and II gives evidence that the PID method is superior 
for the AWGN contaminated images. While DDID gives 
better results for salt &pepper and poissons noise in lesser 
time. 

For synthetic images, PID reconstructs clean contours and 
gradients. Numerically, PID is more competitive than DDID 
when AWGN is added to the synthetic image. 
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TABLE I 

COMPARISON OF PID AND DDID FOR NATURAL IMAGE CONTAMINATED WITH DIFFERENT TYPES OF 
NOISE.( FOR o=25). 


Sr.no 

Type of Noise Added 

DDID 

PSNR(dB) 

PID 

PSNR(dB) 

Time elapsed 
(sec) 

DDID 

PID 

1 . 

AWGN noise 

28.95 

29.01 

13.72 

116.46 

2. 

Salt & pepper noise 

25.38 

24.03 

12.18 

112.01 

3. 

Poissons noise 

30.41 

30.13 

11.84 

115.57 



Original Image Noisy image DDID(28.95dB) PID(29.01dB) 

(20.14dB) 

Fig .4 Comparison of PID and DDID for natural image contaminated with AWGN noise. 



Original Image Noisy image DDID(25.38dB) PID(24.03dB) 


(22.44dB) 

Fig .5 Comparison of PID and DDID for natural image contaminated with Salt & peppers noise. 



Original Image Noisy image DDID(30.41dB) PID(30.13dB) 

(123.58dB) 

Fig .6 Comparison of PID and DDID for natural image contaminated with Poissons noise 
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TABLE II 

COMPARISON OF PID AND DDID FOR SYNTHETIC IMAGE CONTAMINATED WITH DIFFERENT TYPES OF 
NOISE. ( for o=25). 


Sr.no 

Type of Noise Added 

DDID 

PSNR(dB) 

PID 

PSNR(dB) 

Time elapsed 
(sec) 

DDID 

PID 

1 . 

AWGN noise 

30.40 

31.26 

11.85 

111.21 

2. 

Salt & pepper noise 

29.20 

27.04 

19.67 

165.85 

3. 

Poissons noise 

31.60 

32.65 

17.50 

133.60 



Original Image 


Noisy image 
(20.14dB) 


DDID(30.40dB) 


PID(31.26dB) 


Fig .7 Comparison of PID and DDID for Synthetic image contaminated with AWGN 



Original Image Noisy image 

(22.90dB) 

Fig .8 Comparison of PID and DDID for synthetic 



DDID(29.20dB) PID(27.04dB) 

image contaminated with salt and peppers noise 



Original Image 


Noisy image 
(123.68dB) 


DDID(31.60dB) 


PID(32.65dB) 


Fig .9 Comparison of PID and DDID for natural image contaminated with Poissons noise 
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V. CONCLUSION 

In contrast to current state-of-the-art denoising methods, 
our algorithm is short. Despite its simplicity, the algorithm 
delivers high-quality results, outperforming other methods in 
denoising synthetic images. Considering that many methods 
already work well enough for natural images, the new 
challenge is in denoising synthetic images contaminated with 
AWGN. 

After analysing PID for different types of noises ,we have 
came to a conclusion that PID gives excellent visual and 
theoretical results for synthetic images. 
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